MEMORANDUM December 4, 2015 
TO: Board Members 


FROM: Terry B. Grier, Ed.D. 
Superintendent of Schools 


SUBJECT: 2015 DUAL LANGUAGE PROGRAM EVALUATION REPORT 
CONTACT: Carla Stevens, 713-556-6700 


The Texas Education Code (§ 29.051) requires school districts to provide every language 
minority student with the opportunity to participate in either a bilingual or English as a second 
language (ESL) program. Attached is the evaluation report summarizing the performance of 
students who participated in the district's Dual Language Bilingual Program. Included in the 
report are findings from assessments of academic achievement and English language 
proficiency for all students classified as English Language Learners (ELL) who participated in 
the Dual Language program. In addition, the report includes performance results of fluent 
English-speakers enrolled in the Dual Language program, as well as a summary of appraisal 
and retention data for Dual Language teachers. 


Key findings include: 

e =6© A total of 3,531 ELL students participated in the Dual Language program in 2014—2015. 

e Current Dual Language students performed better than students in other bilingual programs 
on almost all subjects of the STAAR (English version), EOC, and lowa Assessments. 

e Current Dual Language students showed declines in reading performance on both the 
Spanish and English STAAR compared to the previous year, but they performed better 
than all students districtwide in mathematics on the English STAAR. 

e Dual Language students showed more improvement in English proficiency than did 
students in other bilingual programs, as measured by the TELPAS. 

e Students served in the Dual Language program but who had exited ELL status did better 
than the district, and better than students from other bilingual programs, in all subjects of 
the STAAR, STAAR EOC, and lowa Assessments. 

e English-speaking students in the Dual Language program showed evidence for bilingualism 
and biliteracy. 


e Dual Language teachers had better overall EVAAS ratings (composite growth index) than 


did non-DL teachers. 
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DUAL LANGUAGE BILINGUAL PROGRAM EVALUATION 2014-2015 


Executive Summary 


Program Description 


The Dual language program in HISD is intended to facilitate English Language Learner (ELL) integration 
into the regular school curriculum and ensure access to equal educational opportunities, while promoting 
biliteracy and bilingualism for both ELLs and native English speakers. The dual language program is 
offered in elementary schools and selected middle schools for language minority students who need to 
enhance their English language skills, but the program also includes English speakers who wish to im- 
prove their Spanish language proficiency. Beginning in prekindergarten, the program provide ELLs with 
a carefully structured sequence of basic skills in their native language, as well as gradual skill develop- 
ment in English through ESL methodology. In dual language programs, the function of the native lan- 
guage is to provide access to the curriculum while the student is acquiring English. Instruction in the na- 
tive language assures that students attain grade level cognitive skills without falling behind academical- 
ly, and also ensures that English-speaking students are immersed in a foreign language. 


The present evaluation of the dual language bilingual program (DL) addresses the following topics: 

e academic progress of dual language ELLs; 

e English proficiency among dual language ELLs and Spanish proficiency of native English speakers; 
e academic progress of native English-speakers enrolled in the dual language program; and 

e the quality, retention, and professional development activities of dual language teachers. 
Highlights 


e There were 3,531 ELLs enrolled in the dual-language bilingual program (DL) in 2014—2015. 


- DL was offered in 31 campuses districtwide, (27 elementary campuses, three secondary, and one K 
-8 campus). 


e Current DL students performed better than did those in other bilingual programs in almost all sub- 
jects of the STAAR (English version), EOC, and lowa Assessments in 2015. 


e« English language performance of both DL students and those in other bilingual programs was gen- 
erally better on mathematics tests than it was on reading or language tests. 


- DLstudents performed better than the district in mathematics (English STAAR). 


e Reading performance of DL students declined in 2015 compared to 2014 on both the Spanish and 
English STAAR. 


e Students who had exited ELL status but who had previously been in DL did better than the district 
average on all subject tests for the STAAR, STAAR-EOC, and lowa. 


e Exited DL students also did better than those who exited from other bilingual programs on all tests. 
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e Onthe TELPAS, fewer DL students scored at the highest level of English proficiency than did other 
bilingual students in grades K-4, but exceeded students in other bilingual programs by grade 5. 


« DL students did show more improvement or growth in English proficiency (as measured by perfor- 
mance on the TELPAS) than did other bilingual students. 


e« Fluent English speakers in DL showed evidence of bilingualism and biliteracy, doing well on both the 
Spanish and English language STAAR reading assessments. 


e DL teachers had better overall EVAAS ratings (composite growth index) than did non-DL teachers, 
although retention rates did not differ for the two groups. 


Recommendations 


1. The dual language program continues to undergo a major expansion. During the 2014—2015 school 
year there were 31 campuses offering the dual language program, with 14 of them in their first year 
of operation. An additional 24 were scheduled to begin in 2015-2016. The district and Multilingual 
Programs department should continue the expansion of the Dual Language program to additional 
elementary campuses as a new implementation, and identify middle schools to continue the pro- 
gramming into grades 6-8. 


2. The district and Multilingual Programs department should explore the plan for the expansion at early 
childhood centers to allow for an early start in bilingualism and biliteracy of prekindergarten students 
feeding into established Dual Language campuses. 


3. As the DL program expands, campus visits should be conducted to provide feedback in order to en- 
sure fidelity to program guidelines and district non-negotiables. 


Administrative Response 


The Dual Language program will continue to be expanded each year at the elementary level and ex- 
plored at middle schools in the vicinity of dual language elementary schools to continue programming in 
the upper grades. Dual language implementation at Early Childhood Centers will be a priority. 


The Dual Language handbook will be revised to include district assessment changes and additional pro- 
gram structure as campus vertical alignment continues. It will continue to serve as the guide of program 
implementation in Dual Language campuses across the district. 


Units of Study for grades kindergarten through second grade have been developed and disseminated to 
all Dual Language campuses. Dual Language Instructional Planning will be conducted prior to each 
grading cycle to familiarize teachers with the curriculum, share instructional best practices, and create 
workstations. 


A core package of instructional bilingual materials has been ordered and will be distributed to all prekin- 
dergarten through second grade Dual Language classrooms. This will ensure consistency and equity in 


programming across the district. 


All dual language campuses will be supported through campus visits during the academic year by repre- 
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sentatives from the Multilingual Programs, Curriculum and Instruction, and Schools Office. Oral and writ- 
ten feedback after each visit will highlight campus best practices and identify areas for growth opportuni- 
ty. Coaching provided by assigned Teacher Development Specialists will strategically target areas iden- 
tified in need of development. 


Dual language teachers will participate in three levels of training, starting with Level 1 during their first 


year of teaching in a DL setting and advancing to another level each year, for a total of 66 hours of face- 
to-face training. Choice staff development sessions are also available for teachers throughout the year. 
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Introduction 


Texas requires school districts to provide specialized linguistic programs to meet the needs of students 
who are English language learners (ELL). These programs are intended to facilitate ELLs' integration 
into the regular school curriculum and ensure access to equal educational opportunities. HISD exceeds 
the state mandate by implementing three bilingual education programs: the Dual-Language Bilingual 
Program (DL), the Transitional Bilingual Program (TBP), and a smaller Cultural Heritage Bilingual Pro- 
gram for Vietnamese-speaking ELLs offered at one campus. The Dual-Language Program differs from 
the Transitional Bilingual Program in two ways: in DL, classes are composed of a mix of Spanish- 
speaking ELLs as well as native English speakers, and there is a higher percentage of instructional time 
offered in Spanish. The dual language program is the focus of this report. 


In the district's dual language program, roughly equal numbers * of ELL and fluent English-speaking stu- 
dents are taught together in an effort to develop full bilingualism and biliteracy for both groups. Partici- 
pating campuses choose between implementing an 80:20 model and a 50:50 model. In the 80:20 model, 
students in kindergarten receive 80 percent of their instruction in Spanish and 20 percent in English. The 
percentage of instruction time in English gradually increases throughout the grade levels, until reaching 
50 percent in grade 3. The 50:50 model differs slightly, in that students receive half of their instruction in 
English and half in Spanish starting in kindergarten, and this mix persists until at least 5th grade.’ 


Recent Changes to the Dual Language Program 


The district has committed to an expansion and revision of its existing dual language program. Five new 
campuses were added to the program in 2013-2014, with 14 new campuses in 2014-2015 and a further 
24 planned for 2015-2016. At each of the new DL campuses, only students up to and including grade 
one are initially enrolled in the program, with higher grades added as students advance. Thus, at the 
present time, the DL program includes a mix of campuses that have been offering the program through 
fifth grade for a number of years, and other campuses that only offer the program at lower grade levels. 
Eventually, all elementary DL campuses will offer the program through fifth grade. The second major 
aim of the DL initiative has been a revision of the program’s curriculum and guidelines. These changes 
have included a standardization of the time and content allocation that campuses will be required to fol- 
low. AS mentioned previously, currently DL campuses have the choice of following either a 50:50 or an 
80:20 model. Under new guidelines, all DL campuses will have to follow the 50:50 model, and the time/ 
content allocation has been modified to correct for inadequacies in the design of the previous plans. 
These changes to the required DL model are being phased in, with students currently in kindergarten 
being the first ones to be instructed under the new guidelines. 


In the summer of 2014, an outside consultant (VIF International Education) was contracted to provide a 
comprehensive review of the existing DL program and to provide recommendations that would facilitate 
the expanded program’s success. Some of the recommendations regarding program evaluation have 
been incorporated into the present report, including new sections on teacher quality and professional 
development activities. 


Methods 


Participants 


ELLs in the dual language bilingual program were identified using 2014-2015 Chancery Student Man- 
agement System (SMS)°, IBM Cognos, and Public Education Information Management System 
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Table 1. Number and Percent of Bilingual ELL Students by Program, 2012-2013 to 2014-2015 


Bilingual Program Enrolled Percent 

2013 2014 2015 2013 2014 2015 
Transitional Bilingual (TBP) 30,764 
Traditional Bilingual (discontinued) 17,009 n/a n/a 44 
Pre-Exit Bilingual 5,436 6,878 7,755 14 17 20 
Developmental Bilingual (discontinued) 14,811 n/a n/a 38 
Dual-Language (DL, Two or One-Way) dl AL7/ 1,831 3,531 3 5 9 
Gomez & Gomez (discontinued) 90 n/a nla <1 
Cultural Heritage 168 162 152 <1 <1 <1 
Mandarin Bilingual 10 20 63 <1 <1 <1 
Other* 0 4 41 0 <1 <1 
Total 38,741 39,659 39,678 


Source: IBM Cognos, Chancery 


* Inappropriate code (ELL student listed as served through a bilingual program which has been discontinued). 


(PEIMS) databases. A summary of enrollment figures for ELLs in the various bilingual programs is 
shown in Table 1. Note that enrollment in DL is substantially lower than enrollment in TBP; 9 percent of 
ELLs served through bilingual programs were served in the dual-language program and 71 percent were 
served in the transitional program. The dual-language bilingual program was offered at 27 elementary 
schools, three secondary campuses, and one K—-8 campuses (See Appendix A for a complete list, p. 
14). The number of campuses offering DL has increased from 12 in 2012-2013 and 17 in 2013-2014, to 
31 for the present year, and an additional 24 campuses are scheduled to start in 2015-2016. All DL stu- 
dents with valid assessment results from 2014—2015 were included in analyses for this report, as were 
all students who had participated in the program but who had since exited ELL status. 


Data Collection & Analysis 


Results for DL students from the State of Texas Assessments of Academic Readiness (STAAR), Lo- 
gramos, lowa Assessments, and Texas English Language Proficiency Assessment System (TELPAS) 
were analyzed at the district level. In addition, results for exited DL students on the STAAR End-of- 
course (EOC) were examined. Comparisons were made between dual-language students, other bilin- 
gual students, and all students districtwide. 


STAAR results are reported for the reading and mathematics tests. For each test, the percentage of stu- 
dents who passed (met satisfactory standard) is shown. For STAAR EOC, the percent of students who 
met satisfactory standard are reported for English | and II, Algebra |, Biology, and U.S. History. In addi- 
tion, for both the STAAR 3-8 and EOC assessments, results from the STAAR Progress and ELL Pro- 
gress measure are reported. Logramos and lowa Assessments results are reported (Normal Curve 
Equivalents or NCEs) for total reading, total language, and total mathematics. 


TELPAS results are reported for two indicators. One of these reflects attainment, i.e., the overall level of 
English language proficiency exhibited by ELLs. For this indicator, the percent of students at each profi- 
ciency level is presented. The second indicator reflects progress, i.e., whether students gained one or 
more levels of English language proficiency between testing in 2014 and 2015. For this second TELPAS 
indicator, the percent gaining one or more proficiency levels in the previous year is reported. Appendix 
B (see p. 15) provides further details on each of the assessments analyzed for this report. 
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Figure 1. Percentage of students who met satisfactorsy standard on STAAR grades 3-8 reading 
and mathematics tests, 2015: Dual language students, other bilingual students, and all students 
districtwide. 
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Results 
What was the academic performance of ELLs in the dual-language program? 
STAAR 


e Figure 1 shows the percent of students in grades 3-8 who met the satisfactory standard for the 
Spanish and English language versions of the STAAR in 2015 (reading and mathematics only). 


e Results are shown for DL students, as well as all students districtwide and students from other bilin- 
gual programs.’ See Appendices C and D for further details (see pp. 16-17). 


e DL students exceeded other bilingual students in all subjects except Spanish reading, but both 
groups were lower than the district in English reading (gaps of -11 and -13 percentage points). 


e Figure 2 shows English STAAR performance in reading and mathematics for 2013 through 2015. 


e« Dual language students showed a decrease of 16 percentage points in reading over this time period, 
compared to -1 point for other bilingual students and -4 points for the district overall. In contrast, DL 
students showed larger gains in mathematics than did either of these groups. 


Figure 2. Percentage of students who met satisfactory standard on STAAR grades 3-8 reading 
and mathematics tests, 2013 through 2015: DL students and all students districtwide (English 
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Figure 3. Percentage of students who met satisfactory standard on English STAAR grades 3-8 
reading test, 2015: Exited DL students, exited students from other bilingual programs, and all 
students districtwide. 
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e STAAR reading results for exited DL students in 2015 are shown in Figure 3. 


e Exited students from the DL program had higher passing rates than the district, and also exceeded 
performance of students from other bilingual programs, in both reading and mathematics. 


e Figure 4 (below) shows the reading and mathematics performance of exited DL students for the 
past three years. Exited DL students (+1 percentage point) and other exited bilingual students (+2 
points) both have improved in reading over this time period, while the district overall has shown a 
decrease (-4 points). Increases in mathematics have been similar for each group (+1 to +2 points). 


e Figure 5 (see p. 8) shows results for the ELL progress and STAAR progress measures (for an ex- 
planation of these measures see Appendix E, p. 18, and Appendix F for details, pp. 19-20). Only 
results for STAAR reading (English) are shown. 


Figure 4. Percentage of students who met satisfactory standard on English STAAR grades 3-8 
reading and mathematics tests, 2013 to 2015: Exited DL, other exited bilingual students, and all 
students districtwide. 


Source: STAAR, Chancery 
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Figure 5. STAAR Progress and ELL Progress performance for DL students, other bilingual stu- 
dents, and all students districtwide, 2015 (Combined Results for Grades 3 through 8, English 
Reading Only). 
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e« Current DL students did slightly less well than did other bilingual students on both ELL and STAAR 
progress measures, but exited DL students outperformed others in the district on the STAAR pro- 
gress measure. 


STAAR EOC 


Figure 6 depicts results for the STAAR-EOC assessment. Shown are results for Algebra I, Biology, Eng- 
lish | and Il, and U.S. History. For each test, the figure shows the percentage of students who met the 
Satisfactory or above standard (dark green). Red indicates the percentage of students who scored Un- 
satisfactory. Figures in parentheses show the number of students tested (See also Appendix G, p. 21). 


Figure 6. STAAR-EOC percent met satisfactory standard for monitored and former 
DLBP students, by subject, 2015: Results are included for all exited dual-language students, 
exited students from other bilingual programs, as well as for the district overall. 
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Exited DL students performed better than the district, and higher than other exited bilingual students, 
on all tests. The highest passing rates were in Biology and U.S. History, with the lowest rates on 
English | and II. However, it should be noted that fewer than 100 exited DL students were tested in 
2015 on the STAAR EOCs. 


Figure 7 (below) shows results for the EOC Progress measure (exited ELLs only). Results show 
that exited DL students did better than students from other bilingual programs, and both groups out- 
performed the district average (see also Appendix H, p. 22. 


Figure 7. EOC Progress performance for DL students, other bilingual students, and all students 
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Logramos and lowa Assessments 


Figure 8 summarizes Logramos and lowa data for the 2014—2015 school year (mean NCE scores 
for total reading, total language, and total mathematics). Results are shown for ELLs in the DL pro- 
gram, other bilingual students, and HISD. The dashed red line indicates an average NCE of 50. 


On the Logramos, students in DL were well above the expected average NCE of 50 in all subjects, 
but were slightly lower than students in other bilingual programs (See Appendix | for details includ- 
ing grade level results, p. 23). 


Dual language performance on the lowa was much lower than it was for the Logramos. DL students 
had average NCE scores below the expected average of 50 in reading and language, but were 


above average (NCE = 51) in mathematics (see also Appendix J, p. 24). 


DL students’ lowa scores exceeded other bilingual students in reading and mathematics. 


Figure 8. Logramos and lowa Assessments Normal Curve Equivalents (NCEs) for DL, other bilin- 


gual students, and students districtwide, 2015: reading, language, and mathematics tests. 
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Figure 9. lowa Assessments Normal Curve Equivalents (NCEs) for exited DL or other bilingual 
(OB) students, and students districtwide, 2015: Reading, mathematics, and language. 
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e« Figure 9 shows lowa results for monitored and former students from the DL program for 2015, as 
well as performance of students who exited other bilingual programs. 


e Scores for exited DL students were higher than those for the district, and also higher than those for 
students who exited other bilingual programs; and this was true for all subjects. 


What were the levels of English proficiency among ELLs in dual-language programs? 


e Figure 10 shows attainment, i.e., the percentage of students scoring at each proficiency level on the 
TELPAS in 2015. Further details can be found in Appendices K and L (pp. 25—26). 


e English proficiency for DL students improved across grade levels, with 91% or more of students 
scoring Advanced or better by grade 5 in 2015. 


Figure 10. TELPAS composite proficiency ratings for DL and other bilingual (OB) students, 2015. 
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% LEP Students 


DL students showed lower overall English proficiency than did students in other bilingual programs, 
but exceeded students in other bilingual programs by grade 5. 


Figure 11. TELPAS yearly progress for DL and other bilingual students, 2015. 
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Figure 11 shows yearly progress, i.e. the percentage of students who made gains in English lan- 
guage proficiency between 2014 and 2015. The percentage of students who made gains in English 
proficiency was higher for DL students than for other bilingual students (57 versus 56 percent). 


What was the academic performance of fluent English speakers in the two-way bilingual pro- 
gram? 


% Met Standard 


Source: STAAR, Chancery 


The goal of the DL program is for students to achieve full bilingualism and biliteracy. Data have al- 
ready been presented on the performance of current and former ELLs in the program. In this sec- 
tion, data are reported from the 1,758 students with fluent English proficiency (FEP) who participat- 
ed in the DL program during 2014—2015. 


Spanish-language STAAR results show that fluent English speakers (n = 162) had higher passing 
rates than did Spanish speaking DL students on the reading test (See Figure 12). 


The passing rate for DL students was the same as for all bilingual students districtwide (69 percent). 


Figure 12. STAAR performance of ELL and FEP students in the DLBP program, 2015: 
percent meeting standard in Spanish and English reading. 
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e English STAAR results show that FEP students (n = 360) also did well in comparison with former DL 
students who have exited ELL status. 


e« Both exited DL students and native-English FEP students, had higher passing rates than the district 
overall on the English STAAR (advantages of +25 and +26 percentage points, respectively). 


How did dual language teachers compare to other district teachers in terms of qualifications and 
retention rate? 


District teachers receive annual ratings on a number of different measures, including EVAAS ratings as 
well as a rating derived from a TELPAS Comparative Growth measure. This section of the report sum- 
marizes these two ratings for teachers assigned to DL classes, compared to other teachers in the dis- 
trict. Only elementary teachers are included here, and the few secondary campuses where DL is offered 
are not considered. 


e Figure 14 shows the distribution of elementary teacher ratings for EVAAS (composite gain index, 
CGI) and TELPAS comparative growth (CG). Dual language teachers are compared to all other 
teachers in the district. For details of analyses see Appendix M (p.27). 


e« DL teachers ratings were more positive for EVAAS, and this difference was statistically significant. 
TELPAS comparative growth did not differ for DL teachers. 


e Teacher retention data indicated that the retention rate for DL teachers (86.9%, or 187/215) was 
slightly higher than that for other HISD teachers (85.9%, or 4,484/5,222, elementary only), but this 
difference was not significant. 


Figure 14. EVAAS CGI and TELPAS CG ratings for DL and other district teachers, 2015. 
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Teacher Rating Measure 


What was the frequency and scope of professional development activities provided to teachers 
and staff serving dual language students? 


Data provided by e-TRAIN indicated that 101 staff development training sessions pertaining to dual lan- 
guage education were coordinated by the Multilingual Department during the 2015-2016 school year. 
These sessions, summarized in Appendix N (p. 28), were attended by total of 4,198 teachers and other 
district staff. Note that individuals may have been counted more than once if they attended multiple 
events (the unduplicated staff count was 1,293). A full record of professional development activities can 
be obtained from the Multilingual Department. 
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Discussion 


Fourteen new campuses were added to the DL program for the 2014—2015 school year. In the 2015-— 
2016 school year, an additional 24 new campuses will be added. Evidence reviewed here indicates that 
the dual language program in HISD provides ELLs with the support needed to succeed academically. 
ELLs who have participated in DL acquire English-language proficiency while in the programs, and out- 
perform the district average on the STAAR, STAAR EOC, and lowa assessments once they have suc- 
cessfully met exit criteria. Native English speakers (FEPs) involved in the program also do well. Based 
on these results, it would appear that the HISD Multilingual Department is fulfilling its mission to ensure 
that ELLs achieve their full academic potential. As the district continues to expand the DL program to 
more campuses and the new DL time and content allocations are introduced at higher grade levels, the 
program's performance will need to be monitored to ensure that this record of success continues. 


Appendices O.1 through 0.18 (pp. 29-46) provide summaries of student performance at the various DL 
campuses. Shown are results for Spanish-speaking DL students in classes with native English-speakers 
(YT), Spanish-speaking DL students in classes where there were no native English speakers (YO), and 
native English-speakers enrolled in the DL program (NT). 


Endnotes 


1. The dual-language model proposes that approximately equal numbers of fluent and non-fluent English speak- 
ers should be enrolled in the class, but practitioners in the field stress that this ratio should be used as a heuris- 
tic and not an absolute rule. Ratios of 60:40 and even 70:30 may be considered appropriate under some cir- 
cumstances. It should not be assumed that a functional dual-language program requires exactly equal number 
of students from both language groups (Collier, personal communication). 


2. This is the sequence normally followed by students in the dual language programs. However, students in both 
the dual-language and the transitional bilingual programs can enter the pre-exit phase (i.e., predominantly Eng- 
lish-only instruction) as early as grade 3, pending LPAC approval, if they have met certain performance criteria. 
These criteria can be found in the district's 2014-2015 Pre-Exit Student Performance Report. 


3. The Chancery system replaced the School Administrative Student Information database system (i.e., SASI), 
which the district used prior to the 2006-2007 school year. Where data from multiple years are shown, archived 
files from SASI were used as needed, thus some tables or figures may include references to both sources. 


4. Note that all districtwide performance data includes results from ELLs enrolled in the dual-language programs, 
as well as all other comparison groups (e.g., monitored and former ELLs). 
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Campuses Offering Dual-Language Programs (DL), 2014-2015 


Appendix A 


ELL Enrolled 2014-2015 


Campus Pecans d Grades Served PK K 1 2 3 4 5 6 HS ie #NT 
Briscoe ES PK, K, 1, 2, 3, 4 
Emerson ES PK, K, 1, 2, 3 
Helms ES PK, K, 1, 2, 3, 4,5 
Herod ES K, 1, 2,3, 4,5 
Herrera ES K, 1, 2, 3, 4,5 
Northline ES | Prior to | PK, K, 1, 2, 3,4,5 
Sherman ES | 2013-14 | PK, K, 1, 2, 3, 4,5 
Twain ES K, 1, 2,3, 4,5 
Wharton K-8 PK, K, 1, 2, 3, 4, 5, 6, 7, 8 
Burbank MS 6, 7,8 
Johnston MS 6, 7,8 
Reagan HS 9, 10, 11, 12 
Daily ES PK, K, 1 
DeandaES | 2013-14 | PK,K, 1, 2 
Kashmere _—— K,1 
Law ES PK, K, 1, 2 
Reagan Ed Ctr K,1 
Anderson ES 
Ashford ES 
Burnet ES K 57 57 a0) 
Coop ES K 51 51 23 
Dogan ES PK, K 40 40 2 82 6 
Garden Villas ES K 42 42 16 
Gregg ES | 2014-15 | K 47 47 32 
RP Harris ES K 60 60 9 
McNamara ES K 94 94 16 
Memorial ES PK, K 27 31 58 19 
Osborne ES K 12 1 1 14 NS) 
Shearn ES PK, K 61 66 127 re 
Whidby ES PK, K 8 7 15 39 
White ES PK, K 47 85 132 Fail 


Source: Multilingual Department, IBM Cognos 
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Appendix B 
Explanation of Assessments Included in Report 


The STAAR is a state-mandated, criterion-referenced assessment used to measure student achieve- 
ment. STAAR measures academic achievement in reading and mathematics in grades 3-8; writing at 
grades 4 and 7; social studies in grades 8; and science at grades 5 and 8. For 2014—2015 high school 
students, STAAR includes end-of-course (EOC) exams in English language arts (English |, II), mathe- 
matics (Algebra I), science (Biology), and social studies (U.S. History). 


With regards to the STAAR 3-8 mathematics assessment, note that in April of 2012, the State Board of 
Education revised the Texas Essential Knowledge and Skills (TEKS) for mathematics. These new 
stadards were implemented for grades K-8 in the 2014—2015 school year, and as a result the STAAR 
mathematics assessment was revised. For this reason, comparison of STAAR mathematics results from 
2015 to those from previous years should be made with caution. 


The lowa Assessments are norm-referenced, standardized achievement tests in English used to assess 
students’ level of content mastery. These assessment provides a means of determining the relative 
standing of students’ academic performance when compared to the performance of students from a na- 
tionally-representative sample. 


The Logramos is a norm-referenced, standardized achievement test in Spanish. It is used to assess the 
level of content mastery for students who receive instruction in Spanish. The total reading, total lan- 
guage, and total mathematics subtests are included in this report for grades 1 through 6. Students take 
the Logramos (Spanish) or lowa (English) according to the language of their reading/language arts in- 
struction. The Logramos and lowa were developed by Riverside Publishing. However, the Logramos is 
not simply a translation of the lowa. The structure and content of the Logramos are aligned with those of 
the lowa, but development and referencing differ in order to provide culturally relevant material for Span- 
ish-speaking student populations across the United States. 


The TELPAS is an English language proficiency assessment which is administered to all ELL students 
in kindergarten through twelfth grade, and which was developed by the Texas Education Agency (TEA) 
in response to federal testing requirements (U.S. Department of Education, 2002). Proficiency scores in 
the domains of listening, speaking, reading, and writing are used to calculate a composite score. Com- 
posite scores are in turn used to indicate where ELL students are on a continuum of English language 
development. This continuum, based on the stages of language development for second language 
learners, is divided into four proficiency levels: Beginning, Intermediate, Advanced, and Advanced High. 
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Appendix C 


Spanish STAAR Performance of Dual Language 
and Other Bilingual Students: Number Tested, 
and Percent Meeting Satisfactory Standard, by Grade Level, Subject, and Year 


Spanish Reading Spanish Mathematics 
Enrollment 2014 2015 2014 2015 

2014 2015 # % # % # % # % 

Program Grade N N tested Met Sat.| tested Met Sat.| tested Met Sat.| tested Met Sat. 
Other 3 4,589 4,023 | 4,212 71 3,781 71 4,125 67 3,592 73 
Bilingual 4 1,706 1,406 1,475 67 1,300 66 1,453 68 1,231 68 
5 343 148 35 37 69 52 33 6 54 46 
Total 6,638 5,577 | 5,722 70 5,150 69 5,611 67 4,877 71 
Dual 3 161 309 159 80 305 70 159 88 305 70 
Language 4 162 215 160 79 192 68 161 73 192 78 
5 153 142 2 ia 5 60 2 * 5 60 
Total 476 666 321 79 502 69 322 80 502 73 

Source: STAAR, Chancery * Indicates fewer than five students tested 
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Appendix D 


English STAAR Performance of Dual-Language Bilingual Program (DL) Students: 
Number Tested, and Percentage Met Satisfactory Standard, 


by Grade Level, Subject and Year 


English Reading 


English Mathematics 


Enrollment 2014 2015 2014 2015 

Program Grade 2014 2015 # % # % # % # % 
N N tested Met Sat./tested Met Sat] tested Met Sat! tested Met Sat. 

Current 3 161 309 2 x 6 67 2 * 3 * 

DL 4 162 215 2 * 23 70 1 * 23 91 

5 153 142 149 70 136 72 150 83 137 83 

6 103 112 96 65 106 51 96 80 97 74 

L 81 87 73 58 81 40 74 62 68 65 

8 75 72 70 60 70 39 68 72 48 77 

Total 735 937 392 64 422 55 391 76 376 77 

Other 3 5676 5424 1,372 70 | 1,580 70 1,417 78 1,704 80 

Bilingual 4 4701 4801 3,062 57 | 3,371 52 3,059 67 3,341 69 

5 3174 3131 2,960 47 | 2,938 46 2,913 70 2,827 67 

6 35 20 32 34 19 32 27 56 16 50 

7 21 7 20 25 5 80 10 60 5 80 

8 17 8 17 12 6 67 6 33 7 57 

Total 13,624 13,391 7,463 55 | 7,919 53 7,432 70 7,900 71 

Exited 3 3 14 3 * 3 = 3 il 3 . 

DL 4 28 5 25 92 5 100 25 88 5 100 

5 20 27 20 80 27 100 20 100 27 96 

6 73 90 73 93 89 85 73 92 89 92 

7 63 102 63 90 102 92 63 84 101 93 

8 57 85 57 95 85 95 26 88 40 88 

Total 244 323 241 92 311 92 210 90 265 92 

Exited 3 67 108 60 95 99 96 60 97 100 93 

Other 4 394 532 389 94 525 92 389 90 526 93 

Bilingual 5 1,453 1,573 1,439 92 | 1,564 93 1,436 94 1,563 94 

6 1,921 1,965 1,889 86 | 1,943 83 1,897 86 1,940 85 

7 1,936 1,852 1,903 82 | 1,835 81 1,862 77 1,764 82 

8 1,844 1,857 1,820 87 | 1,830 85 1,315 83 1,270 77 

Total 7,615 7,887 7,500 87 | 7,796 86 6,959 85 7,163 85 

HISD 3 17,592 17,669 12,201 67 | 12,761 69 12,139 65 | 12,657 71 

4 16,638 17,161 13,875 66 | 14,868 62 13,787 65 | 14,672 68 

5 15,858 16,095 14,673 68 | 15,275 69 14,571 75 | 14,995 73 

6 13,478 13,585 12,453 68 | 12,963 64 12,091 73 | 12,458 70 

7 13,691 13,388 12,768 67 | 12,746 64 12,048 62 | 11,733 65 

8 13,250 13,667 12,414 75 |13,027 68 9,464 72 9,816 65 

Total 90,507 91,565 78,384 69 | 81,640 66 74,100 69 | 76,331 69 


Source: STAAR, Chancery 
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Appendix E 
STAAR Progress and ELL Progress Measures 


Included in this report are two additional performance measures from the STAAR (3-8) and EOC as- 
sessments, STAAR Progress and ELL Progress. Students who took the STAAR or EOC assessments 
can receive either one of these measures, but not both. 


The STAAR progress measure provides information about the amount of improvement or growth that a 
student has made from year to year. For STAAR, progress is measured as a student’s gain score, the 
difference between the score a student achieved in the prior year and the score a student achieved in 
the current year. The Met Standard for the Progress measure is defined as the distance between the 
final recommended performance standards from the prior year grade and the current year grade in the 
same content area. Put another way, the growth standard is (roughly) the improvement that would be 
needed for a student who passed the STAAR one year to be able to pass it the next at the same level. 


STAAR Progress is reported for students who (a) had a valid STAAR score in both 2015 and 2014, (b) 
took the same version of the STAAR in both years, (c) were tested in consecutive grade levels in the two 
years, and (d) were not eligible for the ELL Progress measure. For this report, STAAR Progress is re- 
ported only for students who were tested in English in both years. 


The ELL Progress measure is similar, but the growth standard is based on the number of years it should 
take for the students to reach proficiency in the particular STAAR content area. The expectations vary 
according to both the number of years the ELL students has been attending school, and their English 
proficiency level, as measured by the TELPAS. Thus, students who start at the same absolute perfor- 
mance level on a STAAR assessment may have different growth targets for the purposes of measuring 
ELL Progress, if they differ on either of these factors. 


ELL Progress is reported for ELL students who (a) are classified as ELL, (b) took the English version of 
the STAAR, (c) did not receive a parental waiver for ELL services, and (d) were in their fourth year or 
less of enrollment in U.S. schools. ELL students not meeting these criteria may instead receive the regu- 
lar STAAR Progress measure. Analogous versions of these two measures are reported for the EOC as- 
sessments. 
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Appendix Fa 


STAAR Progress and ELL Progress Performance of Dual Language and Other Bilingual 
Students: Number Tested, and Percent Met Standard, by Grade Level, Reading Only 


READING 

Enrollment ELL Progress STAAR Progress 

# % # % 
Program Grade N tested met tested met 
Dual 3 309 5 60 n/a n/a 
Language 4 215 11 64 1 * 
(Current) 5 142 8 75 3 * 
6 112 15 60 88 42 
7 87 13 15 64 70 
8 72 23 39 43 65 
Total 937 75 48 199 57 
Other 3 5,424 1,179 66 n/a n/a 
Bilingual 4 63 
(Current) 5 62 
6 36 
7 * 
8 * 
Total 62 


Dual 3 
Language 4 5 4 = 
(Exited) 5 27 25 72 
6 90 87 57 
7 102 101 51 
8 85 85 60 
Total 323 302 58 
Other 3 108 n/a n/a 
Bilingual 4 532 495 59 
(Exited) 5 59 
6 43 
7 52 
8 63 
Total 54 

HISD 3 
(Includes ELL 4 17,161 2,873 42 9,945 100 
& Exited ELL) 5 16,095 537 40 12,268 67 
6 13,585 500 35 11,374 42 
7 13,388 613 23 10,939 70 
8 13,667 727 31 11,404 65 
Total 91,565 7,157 44 55,930 57 

Source: STAAR, Chancery * Indicates fewer than five students tested 
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Appendix Fb 


STAAR Progress and ELL Progress Performance of Dual Language and Other Bilingual 
Students: Number Tested, and Percent Met Standard, by Grade Level, Mathematics Only 


MATHEMATICS 
Enrollment ELL Progress STAAR Progress 
# # % 
Program tested tested met 
Dual 3 309 
Language 4 215 
(Current) 5 142 Not Available 
6 112 2015 
7 87 
8 72 
Total 937 
Other 3 5,424 
Bilingual 4 4,801 
(Current) 5 3,131 Not Available 
6 20 2015 
f 7 
8 8 
Total 13,391 
Dual 3 14 
Language 4 5 
(Exited) 5 27 Not Available 
6 90 2015 
7 102 
8 85 
Total 323 
Other 3 108 
Bilingual 4 532 
(Exited) 5 1,573 Not Available 
6 1,965 2015 
7 1,852 
8 1,857 
Total 7,887 
HISD 3 17,669 
(Includes ELL 4 17,161 
& Exited ELL) 5 16,095 Not Available 
6 13,585 2015 
7 13,388 
8 13,667 
Total 91,565 
Source: STAAR, Chancery * Indicates fewer than five students tested 


Note: Because a revised STAAR 3-8 mathematics exam was introduced in 2015, no STAAR Progress measure 
could be calculated since two years of performance data were not available. 
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Appendix G 


STAAR End-of-Course Performance of Exited (Monitored and Former) DL 
Students: Number Tested, And Number and Percentage who Passed or Failed at the 
Phase-In 1 and Recommended Satisfactory Standards (2015 Data Only, All Students 

Tested Including Ret esters) 


2015 Results Phase-in I Satisfactory Standard acai lar roricaeaaes 
re Fail Pass Fail Pass 
Student Group | Tested N % Stu N % Stu N % Stu N % Stu 
Exited DL 94 8 9 86 91 34 36 60 64 
Algebra | Other Exited Bil | 1,907 231 12 1,676 88 879 46 1,028 54 
HISD | 14,183 3,904 28 10,279 72 8,620 61 4,735 33 
Exited DL 81 3 4 78 96 28 35 53 65 
Biology Other Exited Bil | 1,762 105 6 1,657 94 826 47 936 53 
HISD | 13,288 2,098 16 11,190 84 7,528 57 5,248 39 
Exited DL 80 11 14 69 86 25 31 55 69 
English | Other Exited Bil | 1,847 519 28 1,328 72 952 52 895 48 
HISD | 16,289 8,239 51 8,050 49 11,650 72 5,200 32 
Exited DL 51 6 12 45 88 16 31 35 69 
English II Other Exited Bil | 1,315 344 26 971 74 676 51 639 49 
HISD | 14,182 6,707 47 7,475 53 8,722 62 4,927 35 
Exited DL 60 3 5 57 95 20 33 40 67 
eae Other Exited Bil | 1,130 72 6 | 1058 94 441 39 689 «61 
HISD | 10,733 1,531 14 9,202 86 5,539 52 4,581 43 
Source: STAAR, Chancery Note: HISD percentages may differ from district EOC report due to rounding error 
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STAAR EOC Progress Performance of Dual Language and 
Other Bilingual Students: Number Tested, and Percent Met Standard, 


Appendix H 


by Exam Subject 


STAAR Progress 


(Exited ELL) 


# % 
Program Exam tested met 
Dual Algebra | 90 59 
Language English II 49 53 
(Exited) Total 139 57 
Other Algebra | 1,776 55 
Bilingual English II 1,221 50 
(Exited) Total 2,997 53 
HISD Algebra | 11,064 44 
(Includes ELL English II 10,334 47 
& Exited ELL) Total 21,398 45 


Source: STAAR, Chancery 


Note: There was no ELL Progress data for current bilingual students in 2015. The EOC assessments are administered primarily to 


students in 9th grade and higher, and there were no students listed as being in the dual language pogram at those grade levels. 
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Appendix | 


Logramos Performance of DL Students: 
Number Tested and Mean Normal Curve Equivalent (NCE), 
by Grade Level and Subject, 2015 


N Total Reading | Total Language | Total Mathematics 
Program Grade Tested NCE NCE NCE 

Dual 69 
Language 71 
69 
75 
68 
70 
All 72 
Other 75 
Bilingual 70 
75 
58 
* 
73 

Source: Logramos, Chancery * Indicates fewer than five students tested 
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Appendix J 


lowa Assessments Performance of Dual-Language Bilingual (DL) Students: 
Number Tested and Mean Normal Curve Equivalent (NCE), 
by Grade Level and Subject, 2015 


N Total Reading | Total Language | Total Mathematics 

Program Grade Tested NCE NCE NCE 
Current 4 22 43 48 66 
Dual 5 141 43 46 54 
Language 6 102 33 41 48 
7 73 31 46 48 
8 53 30 41 44 
Total 391 36 44 51 
Current 4 3,401 36 47 52 
Other 5 2,985 34 40 47 
Bilingual 6 17 27 33 36 
7 5 32 38 42 
8 7 24 34 34 
Total 6,415 35 44 49 
Exited 4 5 52 67 74 
Dual 5 26 54 62 63 
Language 6 90 46 56 57 
7 101 48 58 59 
8 85 48 56 56 
Total 307 48 57 58 
Exited 4 527 52 65 65 
Other 5 1,566 48 57 61 
Bilingual 6 1,943 42 53 54 
7 1,827 45 55 56 
8 1,824 46 52 53 
Total 7,687 46 55 56 
HISD 4 14,915 44 53 53 
5 15,354 44 50 52 
6 12,674 41 48 48 
7 12,413 42 49 49 
8 12,490 42 47 48 
Total 67,846 43 50 50 


Source: lowa Assessments, Chancery 
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Appendix K 


Composite TELPAS Results: Number and Percent of 
Students at Each Proficiency Level in 2015, by Grade. 
Results Shown Separately for DL and Other Bilingual Students. 


DL Students 
Level pan High Score 
K 1,196 944 79 176 15 68 6 8 1. 1.3 
1 553 290 52 196 35 47 8 20 4 1.6 
2 440 73 17 197 45 115 26 55 13 2.3 
3 312 25 8 104 33 97 31 86 «28 2.7 
4 217 16 7 45 21 89 41 67 = 331 2.9 
5 142 2 1 10 7 37 26 93 65 3.4 
6 112 4 4 11 10 48 43 49 44 3.1 
7 87 9 10 3 3 33 38 42 48 3.0 
8 72 13 18 8 11 21 29 30 42 2.7 
Total 3,131 | 1,376 44 750 24 555 18 450 14 2.0 
All Other Bilingual Students 
Grade Beginning Intermediate | Advanced Advanced Composite 
Level # TeSee High Score 
K 1.2 
1 1.7 
2 2.3 
3 2.7 
4 2.8 
5 3.0 
6 2.6 
7 * 
8 3.3 
Total 2.2 
Source: TELPAS, Chancery * Indicates fewer than five students tested 
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Appendix L 


TELPAS Yearly Progress: Number and Percent of 
Students Gaining One or More Levels of English Language Proficiency in 2015, 
by Grade. Results Shown Separately for DL and Other Bilingual Students. 


DL Students 

Grade Cohort Gained 1 Gained 2 Gained 3 Gained at Least 1 
Level Size Proficiency Level | Proficiency Levels | Proficiency Levels | Proficiency Level 

N N % N % N % N % 

1 510 197 39 25 5 0 0 222 44 

2 417 205 49 76 18 3 1 284 68 

3 298 151 51 7 2 0 0 158 53 

4 206 100 49 1 0 0 0 101 49 

5 136 110 81 2 1 0 0 112 82 

6 107 67 63 0 0 0 0 67 63 

7 78 55 71 1 1 0 0 56 72 

8 58 35 60 0 0 0 0 35 60 

Total 1,810 920 51 112 6 3 <1 1,035 57 

All Other Bilingual Students 

Grade Cohort Gained 1 Gained 3 Gained at Least 1 
Level Size Proficiency Level | Proficiency Levels | Proficiency Levels | Proficiency Level 

N N % N % N % 

1 5,553 2,044 37 75 1 2,614 47 

2 5,444 2,634 48 112 2 3,542 65 

3 5,091 2,650 52 1 0 2,796 55 

4 4,523 2,444 54 2 <1 2,517 56 

5 2,900 1,710 59 2 <1 1,773 61 

6 12 8 67 0 0 8 67 

7 Hl * * * * * * 

8 2 * * * * * * 

Total 23,526 11,493 49 192 1 13,253 56 

Source: TELPAS, Chancery * Indicates fewer than five students tested 
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Appendix M 
Analyses of Teacher Appraisal Data 


There were two sources of data for the analyses related to teacher appraisals: EVAAS (Education Val- 
ued-Added Assessment System) ratings and TELPAS comparative growth. For each of these analyses, 
teachers were first identified if they were the teacher of record and had a home room assignment in 
2014-2015, with at least 10 students listed (Source: Chancery/Cognos). This list included a total of 5,660 
teachers in grades PK through 5. Of these, a further 217 were identified as dual-language teachers by 
virtue of (a) teaching at one of the designated DL campuses, and (b) having at least 10 DL students in 
their classroom. Since both of these teacher appraisal measures only cover teachers in grades 3 
through 5, note that teachers in grades 2 and lower were not included in the analyses reported. 


For EVAAS, the teacher's composite gain index (CGI) was used. This measure summarizes a teacher's 
relative growth across all subjects taught. Forty dual-language teachers received EVAAS ratings, and 
there were 1,753 other teachers who served as the comparison group. Gain index scores were convert- 
ed to a rating based on the following five-point scale: 


EVAAS 
Composite Gain Rating Interpretation 
Index 
2.0 or greater Well above average 
1.0 to 1.99 Above average 


5 
4 
3 
2 
1 


-1.0 to 0.99 Average 
-2.0 to -1.01 Below average 
< -2.0 Well below average 


As the data in Figure 14 indicates, 56% of DL teachers received EVAAS scores of 4 or better (above or 
well above average), compared to 34% for all other HISD teachers at these grade levels. Interpreted as 
an odds ration, this means that DL teachers were more than twice as likely to have an EVAAS rating of 
4 or better than were other teachers. This difference was highly significant (Z = 2.82, p<.03). 


A TELPAS comparative growth measure is calculated annually for all teachers of ELLs in grades 3 
through 8 for use in the Teacher Appraisal and Development System (TADS). Teachers at these grade 
levels receive a TELPAS CG rating if they selected 'TELPAS' as the subject taught during the spring 
linkage and verification process. Full TADS data was unavailable at the time of publication, but those 
homeroom teachers who received a TELPAS comparative growth (CG) score were included in a sec- 
ondary analysis, also summarized in Figure 14. Thirty-one DL teachers received TELPAS CG ratings, 
and 581 other teachers also received a rating. The data showed that 65% of DL teachers and 64% of 
other teachers received TELPAS ratings of 3 or 4, meaning that the TELPAS reading performance of 
students did not significantly distinguish DL from other teachers. 
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Appendix N 


Summary of Professional Development Training Attended by Teachers in the Dual Lan- 
guage Bilingual Program 


Biliteracy Development | 1.2 MLO277 453 6 
Biliteracy Development II 2.1 MLO0275 39 3 
Biliteracy Development II 2.2 MLO275 113 4 
Development DL Units of Study MLO243 55 4 
Dinner & Dual 1 ML0270 41 1 
Dinner & Dual 2 MLO271 30 1 
Dinner & Dual 3 MLO272 60 1 
DL Administrator Overview MLO279 43 2 
DL Essentials & Bil Workstatio MLO256 69 2 
DL Essentials 1.1 Pre-K MLO294 19 1 
DL Inst. Planning GR 1 MLO316 42 3 
DL Inst. Planning GR 2 MLO317 12 2 
DL Inst. Planning K MLO315 106 5 
DL Inst. Planning PK MLO314 72 4 
DL Inst. Planning/WS/ Gri MLO320 13 2 
DL Inst. Planning/WS/ K MLO319 19 3 
DL Inst. Planning/WS/ PK MLO318 31 4 
Dual Lang Teaching Biliteracy MLO229 45 1 
Dual Lang. Biliteracy Training MLO261 27 1 
Dual Language Biliteracy MLO245 114 2 
Dual Language Book Study Teach MLO231 44 5 
Dual Language Essentials MLO234 98 2 
Dual Language Essentials 1.1 MLO269 320 3 
Dual Language Just in Time C1 MLO252 80 2 
Dual Language Just in Time C2 MLO253 91 2 
Dual Language Just in Time C3 MLO254 64 2 
Dual Language Just in Time C4 MLO255 32 2 
Exploration of DL Resources MLO266 126 3 
GLAD 2Day Strategies Overview MLO291 75 1 
GLAD 4Day Classroom Demonstrat MLO292 106 2 
JobAlike2015: K-4 SLAR/DL MLO0282 939 2 
Language Transfer & Beyond 2.2 MLO276 85 2 
Language Transfer 1.3 MLO278 332 5 
Language Transfer 1.3 Pre-K MLO296 23 1 
Language Transfer and Beyond MLO244 120 2 
Language Transfer Training MLO0262 40 1 
Literacy Dev. & Language Trans MLO225 104 2 
Project GLAD AdminOverview 2.0 MLO0284 34 1 
Writing Gr 2 Units of Study MLO274 82 9 
TOTAL 4,198 101 
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Appendix O.18 


TELPAS Yearly Progress of Dual-Language Bilingual Program (DL) Students by Campus 


Number of Students Percent of Students 
YT YO YT Yo 

Campus Cohort #Gain eos Cohort #Gain hoe % Gain a % Gain a 
Anderson ES 1 © . = * 
Briscoe ES 71 46 25 17 9 8 65 35 53 47 
Burbank MS 238 153 85 64 36 
Daily ES 11 4 7 36 64 
Deanda ES 149 75 74 50 50 
Dogan ES 2 * * * * 
Emerson ES 97 70 27 56 27 29 72 28 48 52 
Helms ES 133 66 67 50 50 
Herod ES 86 62 24 72 28 
Herrera ES 92 64 28 144 18 71 70 30 51 49 
Johnston MS 3 . 7 * * 
Kashmere 3 e & es rs 
Gardens ES 
Law ES 46 21 25 46 54 
Northline ES 156 101 55 112 34 78 65 35 30 70 
Reagan Ed Ctr 31 18 13 21 14 7 58 42 67 33 
Sherman ES 95 70 25 63 10 Se) 74 26 16 84 
Twain ES 31 14 17 45 55 
Wharton K-8 123 74 49 60 40 
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* Indicates fewer than five students tested 
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